overfitting

A Machine Learning model overfits when it learn by memorization all the possible examples in the training set and fits them in an overly complex manner that does not generalize well to the test set or beyond.

In the particular case of neural networks, a phenomenon called Grokking can occur beyond the overfitting step, where the model learns a more compact and sparse solution to the